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Abstract 


We  define  2k'p  fractional  factorial  designs  which  use  all  of  their  degrees  of 
freedom  to  estimate  main  effects  and  two-factor  interactions  as  second  order  saturated 
(sos)  designs.  We  prove  that  resolution  IV  sos  designs  project  to  every  other  resolution 
IV  design,  and  show  the  details  of  these  projections  for  every  n  =  32  and  n  =  64  run 
fraction.  For  k >  (5/1 6)n,  all  resolution  IV  designs  are  a  projection  from  the  even  sos 
design  at  k  =  n/2.  For  k  <  (5/16)n  the  minimum  aberration  design  resolution  IV  designs 
are  projections  of  sos  designs  with  both  even  and  odd  words  in  the  defining  relation. 
While  even  resolution  IV  designs  are  limited  to  estimating  fewer  than  n/2  two-factor 
interactions  (in  addition  to  the  k  main  effects),  resolution  IV  designs  with  odd-length 
words  in  the  defining  relation  may  devote  more  than  half  of  their  degrees  of  freedom  to 
two-factor  interactions.  We  propose  a  method  to  search  for  good  resolution  IV  designs 
using  naive  projections  from  even/odd  sos  designs.  We  introduce  the  alias  length  pattern 
as  a  tool  to  help  characterize  designs.  We  describe  how  the  matrix  T  =  DU  for  a  design 
D  is  useful  in  searching  for  designs.  We  list  the  resolution  IV  even/odd  minimum 
aberration  designs  for  n  =  128  and  provide  a  catalog  of  the  best  resolution  IV  even/odd 
designs  for  n  =  128.  These  results  are  based  on  an  isomorphic  check  using  a  convenient 
function  of  T,  as  well  as  the  set  of  projections  of  a  design.  Finally,  we  suggest  a  new 
method  for  finding  good  regular  resolution  IV  designs  for  large  n  (>  128)  and  provide  a 
preliminary  table  of  good  resolution  IV  even/odd  designs  for  n  =  256. 

Key  words:  alias  length  pattern,  defining  contrast  subgroup,  Hamming  distance  matrix, 
isomorphism,  minimum  aberration,  projection,  regular  designs,  word  length  pattern. 


v 


Disclaimer 


The  views  expressed  in  this  dissertation  are  those  of  the  author  and  do  not  reflect 
the  official  policy  or  position  of  the  United  States  Air  Force,  Department  of  Defense,  or 
the  U.S.  Government. 


Table  of  Contents 


1.  Introduction . 1 

2.  Resolution  IV  Designs  of  Size  32  and  64 . 7 

3.  Projection  Design  Search  Method . 13 

4.  Detecting  Isomorphic  Designs . 15 

5.  Advantages  and  Uses  of  the  FMatrix . 20 

6.  Functions  of  the  T  Matrix . 23 

7.  Exhaustive  Even/Odd  Design  Search  Method . 28 

8.  Resolution  IV  Designs  of  Size  128 . 30 

9.  Incomplete  Enumeration  of  Designs  Based  on  Word  Length  Pattern . 35 

10.  An  Improved  Imperfect  Isomorphic  Rule  Approach . 37 

11.  Interesting  Designs  of  Size  128 . 40 

12.  Finding  Good  Designs  Using  Naive  Projections . 44 

13.  Preliminary  Results  for  Resolution  IV  Designs  of  Size  256 . 56 

14.  Conclusions . 67 

References . 69 

Appendices . 73 

Appendix  A:  Yates  Column  Order  Design  Matrix . 74 

Appendix  B:  Catalog  of  Even/Odd  Resolution  IV  Design  for  n  =  64 . 77 

Appendix  C:  Catalog  of  Designs,  n  =  128 . 87 

Vita . 190 


vii 


Table  2. 1 :  Even-Odd  Resolution  IV  Designs  of  Size  32 


’1 1 

□Li  *i—i  • 

ft  ^ 

<8  Q  i 


<D  H 
N  P  ' 

£  C  ■ 

4h  <D 


«  &0, 

T3  'Ti  I 


fi|! 

00  C3 

<N  ^ 


^  ^  ^  ^  ^  ^  ^  ^  ^  ^  r-H  eft  Tt 

^.0'—»-'r-Hr-.fN5<N(Nr4(N(N(Nrnrftrftrn 

OOOO*— <»— (1— <T— Ir—<1 — I  *— I  ,— i  ,_h 

QD  _  <D  <U  <L>  <L>  <1>  QJ>  .  d>  QJj  <u  1)  d>  (D  CD  <D  <D  <D  <D 

’2(S????2S3333332323 

5  2  5  L  S  [®  .M  rB  ,S  ,®  ,S  ,a  «  "*  «  «8 

HE— 1  HHHHHHHHHHt-'E-'HHHH 


vin 


List  of  Figures 

Figure  2.1:  Schematic  of  Proj ections . 9 

Figure  2.2:  Design  Structure  for  9-4.2 . 12 

Figure  2.3:  Design  Structure  for  13-7 .b . 12 

Figure  6. 1 :  2^2  T  Matrix,  Pairs  of  Columns . 26 

Figure  12.1:  Design  13-7.b  Generators  and  Aliasing  for  Embedded  Projections . 46 

Figure  12.2:  Design  20-14.a  Generators  and  Aliasing  for  Embedded  Projections . 47 

Figure  12.3:  Existence  of  SOS  Designs . 49 


ix 


1.  Introduction 


Two-level  fractional  factorial  designs  are  widely  used  to  investigate  the  effect  of 
large  numbers  of  parameters  for  complex  computer  models.  Each  parameter  is  varied 
over  a  high  and  low  setting  of  possible  operating  conditions  to  build  a  model  to  help 
explain  the  relationship  of  the  parameters  to  the  outcome  of  the  computer  model.  A  2k'p 
fractional  factorial  design  with  k  parameters  or  factors  at  two  levels  will  consist  of  n  = 

2k'p  runs.  This  design  is  a  2'pth  fraction  of  the  2k  full  factorial  design  where  the  fraction  is 
determined  by  p  defining  words.  A  "word"  consists  of  "letters"  which  are  the  names  of 
the  factors  denoted  by  A,  B, . . .  (or  1 , 2, ...,).  The  number  of  letters  in  a  word  is  the  word 
length.  The  group  formed  by  the  p  defining  words  and  their  generalized  interactions  is 
called  the  defining  contrast  subgroup  (Wu  and  Hamada  2000,  p.157).  The  defining 
contrast  subgroup  consists  of  2P  -1  words  plus  the  identity  column  (commonly  denoted  as 
I).  The  defining  contrast  subgroup  can  be  used  to  study  all  the  aliasing  relations  among 
effects. 

Every  regular  design  can  be  categorized  by  the  word  length  pattern  of  its  defining 
contrast  subgroup.  For  a  2k'p  design,  let  Wi  denote  the  number  of  words  of  length  i  in  its 
defining  contrast  subgroup.  The  vector  wlp  =  (wi, . . .,  Wk)  is  called  the  word  length 
pattern  of  the  design.  The  resolution  of  a  2k'p  design  is  defined  to  be  the  smallest  r  such 
that  wr  >  1 .  This  means  the  length  of  the  shortest  word  defines  the  resolution.  Box  and 
Hunter  (1961)  proposed  the  maximum  resolution  criterion  as  a  method  to  categorize  and 
compare  designs.  Later,  Fries  and  Hunter  (1980)  introduced  the  minimum  aberration 
criteria.  This  criterion  allows  any  two  designs  to  be  rank  ordered  according  to  their  word 
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length  patterns.  This  is  the  most  common  criterion  used  today  to  judge  the  goodness  of 
designs. 

In  addition  to  wlp,  we  introduce  a  new  criterion  based  on  the  alias  length  pattern 
to  help  find  and  characterize  resolution  IV  designs.  We  define  the  alias  length  pattern  as 
the  frequencies  of  the  lengths  of  the  alias  sets  for  two-factor  interactions: 
alP=(ai>a2  where  ax  is  the  number  of  clear  two-factor  interactions,  a2  is  the 
number  of  pairs  of  aliased  two-factor  interactions,  etc.,  up  to  a ,  which  is  the  number  of 

the  largest  set  of  /  aliased  two-factor  interactions  ( /  <  -  I ,  we  define  this  value  as  L 

V  i_2  J  J 

The  alias  length  pattern  (alp)  also  contains  other  important  information: 

i 

•  The  number  of  degrees  of  freedom  for  two- factor  interactions:  at 


•  The  number  of  length  four  words  in  the  defining  relation:  w4  = 


I 


i=V 


All  regular  2kIvp  designs  of  size  n  -  64  or  less  have  been  identified  previously;  see 


Chen,  Sun  and  Wu  (CSW)  (1993)  and  Sun  (2001).  However,  for  n  =  128,  all  possible 
resolution  IV  designs  have  not  been  identified.  Butler  (2003)  provided  theory  for 
constructing  regular  minimum  aberration  designs  with  n  runs  and  5«/16  <  k  <  n  factors. 

We  have  identified  all  remaining  minimum  aberration  designs  for  n  =  128,  that  is,  for 
k  <  5w/16. 


For  cases  with  n  =  128  or  more,  search  algorithms  are  currently  used  to  identify 
attractive  fractional  factorial  designs  having  the  specified  size  and  other  characteristics. 
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For  example,  PROC  FACTEX  in  SAS/QC®  software  (SAS  Institute  Inc.,  1999)  searches 
for  minimum  aberration  designs  for  any  given  k  <  2r.  However,  due  to  the  magnitude  of 
die  computation  for  large  n  and  certain  values  of  k,  exhaustive  searches  are  not  feasible 
given  current  computing  speeds.  The  FACTEX  procedure  returns  the  best  design  it  finds 
in  the  allotted  search  time.  It  does  not  necessarily  find  the  minimum  aberration  design. 
This  paper  will  propose  an  alternative  search  method  for  tabulating  good  designs  for  n  = 
256  and  larger. 

It  is  well  known  that,  for  k<n/2  factors  and  n  =  8, 16, 24,  32, ...,  there  exist 
resolution  IV  designs.  When  k  =  n/2,  the  design  is  known  as  a  minimal  design  of 
resolution  IV  (Montgomery  2001,  p.  347).  These  minimal  designs  may  be  obtained  by 
foldover  of  a  saturated  orthogonal  main  effects  design  of  size  n/2.  For  any  n  =  2r  (with 
r  >  3),  a  regular  minimal  design  may  be  constructed  by  using  all  the  odd  interactions  of 
the  r  basic  columns  as  generators.  For  example,  for  r  =  5,  the  1 1  generators  for  the  2)6v~n 


design  are  the 


5 ;> 
,3, 


=  10  three-factor  interactions  and  the  single  five-factor  interaction. 


Alternatively  one  may  arrange  the  n  -  1  columns  of  a  saturated  main  effects  design  in 
Yates  order  (e.g.,  see  Appendix  A),  and: 

•  select  every  other  column  starting  with  the  first  or 

•  select  the  last  n/2  columns. 

Li  and  Mee  (2002)  present  an  alternative  set  of  n/2  columns  to  create  this  minimal  design. 
For  the  remainder  of  this  article,  we  restrict  our  attention  to  regular  resolution  IV  designs. 


®  SAS  and  all  other  SAS  Institute  Inc.  product  or  service  names  are  registered  trademarks  or  trademarks  of 
SAS  Institute  Inc.  in  the  USA  and  other  countries. 
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The  minimal  2k~p  designs  are  even  designs,  in  that  every  word  in  the  defining 
relation  is  of  even  length.  Li  and  Mee  (2002)  showed  that  every  2k~p  design  with 
5«/l6  <k<n/  2  must  be  an  even  design.  Even  designs: 

•  alias  even  effects  with  other  even  effects,  and  odd  effects  with  odd. 

•  allocate  n! 2  degrees  of  freedom  to  odd  effects,  and  n/2  —  1  degrees  of  freedom  to  even 
effects 

•  provide  at  most  n/2  -  1  degrees  of  freedom  for  estimating  two-factor  interactions,  and 
at  least  n/2  -  k  degrees  of  freedom  for  three-factor  or  higher-order  interactions. 

For  instance,  the  minimum  aberration  2^~6  design  -  an  even  design  -  permits  estimation 

of  1 1  main  effects,  1 5  two-factor  interactions,  while  leaving  five  degrees  of  freedom  for 
aliased  three-factor  interactions. 

By  contrast,  2kIvp  designs  with  half  of  the  words  in  the  defining  relation  with  odd 
length  may  provide  more  than  n/2  -  1  degrees  of  freedom  for  two-factor  interactions.  For 
instance,  the  minimum  aberration  2)°v'5  design  supports  estimation  of  all  10  main  effects 
and  21  two-factor  interactions.  Because  of  this  greater  capacity  for  estimating  two-factor 
interactions,  this  work  will  focus  on  the  construction  of  even/odd  2 %p  designs.  While 

such  designs  do  not  exist  for  n  =  16  and  are  rather  rare  for  n  =  32,  even/odd  designs  are 
common  for  larger  n  if  k  <5«/l6. 

One  of  the  challenging  aspects  of  searching  for  new  designs  is  determining  when 
two  designs  are  equivalent  or  isomorphic.  (Two  designs  are  isomorphic  if  the  defining 
relation  of  one  can  be  mapped  into  the  defining  relation  of  the  other  through  a  relabeling 
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of  the  factors  and  level  exchanges.)  Draper  and  Mitchell  (1967, 1968, 1970)  wrote  a 
series  of  three  articles  which  used  an  algorithm  to  determine  isomorphic  designs.  Their 
original  method,  called  "sequential  conjecture"  (1967)  found  a  relabeling  map  for 
isomorphic  designs.  They  noted  in  their  next  paper  (1968)  that  word  length  pattern  did 
not  uniquely  identify  designs  but  it  provided  an  alternative  to  their  permutation 
subroutine  (sequential  conjecture  procedure)  for  testing  isomorphic  designs  when  the 
time  required  to  conduct  the  isomorphic  checks  become  prohibitive.  The  trade-off  of 
using  word  length  pattern  is  that  the  designs  found  may  not  be  a  complete  set.  Draper 
and  Mitchell  (1970)  introduced  the  "letter  pattern  comparison"  (now  commonly  known  as 
the  letter  pattern  matrix)  as  a  way  to  identify  designs  instead  of  the  computationally 
burdensome  sequential  conjecture  procedure.  They  make  the  conjecture  that  the  letter 
pattern  matrix  approach  uniquely  determines  designs.  Chen  and  Lin  (1991)  provide  a 
counter-example  to  this  conjecture.  Additional  counter-examples  appear  later  in  section 
1 1  in  this  dissertation. 

Chen,  Sun,  and  Wu  (1993)  developed  an  algorithm  for  constructing  regular 
fractional  factorial  designs  that  required  a  complete  mapping  for  each  design  that  shared 
word  length  pattern.  This  method  insured  that  no  non-isomorphic  designs  were  lost,  but 
became  computationally  infeasible  for  n  =  128  or  larger. 

Sun,  Li,  and  Ye  (2002)  proposed  a  sequential  method  for  constructing  non¬ 
isomorphic  orthogonal  designs  and  an  algorithm  for  detecting  isomorphic  designs  for 
both  regular  and  non-regular  designs.  Their  algorithm  is  based  on  the  concept  of  minimal 
column  base.  A  column  base  is  a  subset  of  columns  of  a  design,  such  that  no  two  rows 
are  identical  to  each  other.  A  minimal  column  base  is  the  smallest  possible  number  of 
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columns  for  a  given  design.  Sun,  Li,  and  Ye  check  the  mapping  for  the  minimal  column 
bases  for  two  designs  with  the  same  word  length  pattern.  They  repeat  this  until  an 
isomorphic  mapping  is  found  or  all  the  possible  minimal  bases  for  the  two  designs  have 
been  checked.  See  Sun,  Li,  and  Ye  (2002)  for  details.  This  method  is  successful  for  both 
regular  and  non-regular  designs  and  especially  useful  for  designs  with  small  n. 

In  the  following  section,  we  focus  on  the  structure  of  even/odd  resolution  IV 
designs  of  size  32  and  64.  We  use  these  known  cases  to  introduce  some  definitions  and 
indicate  the  structure  one  could  exploit  in  the  larger  cases  where  all  designs  are  not 
known. 
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2.  Resolution  IV  Designs  of  Size  32  and  64 

Only  five  even/odd  2k~p  designs  of  size  32  exist;  refer  to  Table  2.1.  For 

convenience,  we  use  Chen,  Sun,  and  Wu's  method  of  labeling  designs  where  10-5.1 
designates  the  first  (best)  32  run  design  with  ten  factors  and  five  generators.  Two  of 
these  designs  (10-5.1  and  9-4.2)  utilize  all  31  degrees  of  freedom  for  estimating  main 
effects  and  two-factor  interactions.  We  will  refer  to  any  2kiyp  design  (both  even  and 
even/odd  designs)  that  uses  all  of  its  degrees  of  freedom  for  estimating  main  effects  and 
two-factor  interactions  as  a  second  order  saturated  {sos)  design.  Each  of  the  non-sos 
designs  is  a  projection  of  at  least  one  of  these  sos  designs.  For  instance,  delete  any 

column  from  10-5.1  and  one  obtains  design  9-4.1. 

Theorem  2.1:  Every  2k'p  non-sos  resolution  IV  design  is  the  projection  of  at  least 

one  sos  resolution  IV  parent  design. 

Suppose  there  exists  a  2  )yp  non-sos  design.  A  non-sos  design  is  defined  as  a 
design  that  does  not  utilize  all  2k'p  - 1  degrees  of  freedom  for  estimating  main  effects  and 
two-factor  interactions. 


Table  2.1: 

Even-Odd  Resolution  IV  Designs  of  Size  32 

Design 

Generators 

df 

wlp 

alp 

E/O  Projections 

10-5.1 

7,11,19,  29,  30 

31 

10,16,0,0,5 

0,20,0,0,1 

9-4.1 

9-4.1 

7, 11,29, 30 

30 

6, 8, 0,0,1 

8,12,0,1 

8-3.1 

9-4.2 

7,11,13,  30 

31 

7, 7, 0,0, 0,1 

15,0,7 

8-3.1 

8-3.1 

7,11,29 

29 

3,4 

13,6,1 

7-2.1 

7-2.1 

7, 27 

25 

1,2 

15,3 
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A  non-sos  design  therefore  has  "available  columns"  for  the  unused  degrees  of  freedom. 
An  available  column  is  any  column  that  is  not  aliased  with  a  main  effect  or  two-factor 
interaction. 

Suppose  we  add  a  new  factor  to  our  design,  with  an  available  column  as  its 
generator.  The  new  factor  "z"  multiplied  by  its  generator  will  appear  as  an  additional 
word  in  the  defining  contrast  subgroup.  The  new  word  is  necessarily  of  length  four  or 

more  and  the  resulting  design  with  k  +  1  factors  must  be  resolution  IV  for  the  reason 
given  below. 

Suppose  it  is  not  resolution  IV;  then  this  would  mean  there  is  a  word  in  the 
defining  contrast  subgroup  of  length  three  or  less.  This  implies  that  a  new  word  contains 
z  (since  z  appears  in  all  the  new  words)  plus  two  or  fewer  other  letters.  This  implies  that 
z  is  aliased  with  either  a  main  effect  or  two-factor  interaction,  which  contradicts  the  fact 
that  the  generator  was  an  "available  column".  Therefore  the  resulting  k  +  1  factor  design 
must  be  resolution  IV. 

Now  this  k  +  1  factor  resolution  IV  design  is  either  a  second  order  saturated 
design  with  no  more  available  columns,  or  a  non-sos  design  with  an  available  column.  If 
not  sos,  the  process  can  be  repeated  until  the  design  becomes  a  second  order  saturated 
design.  Therefore,  all  non-sos  2k~p  designs  have  at  least  one  resolution  IV  sos  parent. 

Corollary  2.1 :  All  non-sos  even/odd  resolution  IV  designs  are  the  projection  of  an 
even/odd  resolution  IV  sos  design. 

Even/odd  designs  may  project  to  either  an  even  design  or  an  even/odd  design 
while  even  designs  only  project  to  other  even  designs  (see  Figure  2.1). 
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Figure  2.1:  Schematic  of  Projections 


Lemma  2.1:  If  the  delete-one-column  projections  of  an  even/odd  resolution  IV 
design  include  multiple  even  designs,  the  even  designs  must  be  isomorphic. 

We  know  that  an  even  design  will  have  all  even  length  words  in  the  defining 
relation  while  an  even/odd  design  has  2P~X  odd-length  words  and  2P~X  -1  even-length 
words.  If  an  even/odd  design  projects  to  an  even  design,  then  all  the  odd  length  words 
have  been  removed.  Note  that  the  projected  even  design  may  be  written  as  a  2(*",Hp_1) ; 
so  half  of  the  words  in  the  defining  relation  have  been  removed.  Therefore  all  the  odd 
length  words  must  contain  the  deleted  column.  Any  other  even  projection  must  be 
isomorphic. 

Table  2.1  includes  the  generators,  degrees  of  freedom  (for  main  effects  and  two- 
factor  interactions),  word  length  pattern  (wlp)  and  the  alias  length  pattern  (alp)  for  each 
of  the  32-run  even/odd  designs.  For  example,  design  9-4.1  has  a\  =  8  clear  two-factor 
interactions,  a2=  12  pairs  of  aliased  two-factor  interactions,  a4=  1  set  of  four  aliased  two 
factor  interactions,  and  9  +  21  =  30  degrees  of  freedom  for  main  effects  and  two-factor 
interactions. 
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The  catalog  of  designs  in  Appendix  B  shows  all  148  even/odd  2)yp  designs  of 

size  64.  Here  we  use  our  own  notation  to  identify  the  designs  since  CSW  (1993)  did  not 
list  all  the  n  =  64  designs  in  their  catalog  and  their  ordering  did  not  accord  with  any 
obvious  criteria.  We  rank  the  alternative  2 )yP  designs  for  a  given  k  using  the  following 
criterion: 

1 .  Smaller  W4 

2.  For  designs  with  the  same  W4,  smaller  W5 

3.  For  designs  with  the  same  (W4,  W5),  larger  a\ 

To  avoid  confusion  with  the  CSW  numbering,  we  use  the  letters  a,  b, ...  rather  than 
numerals  to  index  the  designs.  Table  B.l  does  include  a  column  identifying  the  CSW 
number  for  those  designs  that  are  included  in  their  1993  catalog. 

We  make  the  following  observations  regarding  the  catalog  in  Appendix  B.  First, 
there  are  only  eight  even/odd  second  order  saturated  resolution  IV  designs  of  size  64: 

•  20-14.a 

•  18-12.C 

•  17-ll.b,d,e,g,j 

•  13-7.b 

Second,  a  non-sos  design  in  Appendix  B  may  be  the  projection  of  more  than  one  sos 
design.  For  instance,  16-10.b  is  the  projection  of  either  sos  design  17-1  l.b  or  17-11  .d. 

Note  that  each  n  =  8, 16,  32,  ...  there  is  only  one  even  resolution  IV  second-order 
saturated  (sos)  design,  the  minimal  design  with  k  —  n/2.  Thus,  the  following  results  are 
apparent: 
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•  For  n  =  8  and  16,  there  exists  only  the  unique  even  sos  design  with  k  =  nil. 

•  For  n  =  32,  there  exist  three  sos  designs,  with  k  =  9, 10,  and  16. 

•  For  n  =  64,  there  exist  nine  sos  designs,  with  k  =  13, 17, 18, 20,  and  32. 

The  sos  designs  with  the  smallest  k  are  of  particular  interest  because  these  designs 
provide  the  most  degrees  of  freedom  for  two-factor  interactions.  We  examine  the  9-4.2 
and  13-7 .b  designs  now.  Design  9-4.2  has  w4  =  7,  and  these  length-four  words  involve 
only  seven  of  the  nine  factors.  Thus,  all  the  interactions  involving  two  factors  are  clear. 

This  design  is  structured  as  *22],  where  the  one-half  fraction  of  the  product  array 

is  obtained  by  dividing  each  smaller  design  into  two  blocks  and  then  taking  only  two  of 
the  four  block  combinations  (see  Figure  2.2 )  where  the  2 has  generators  6  =  123, 7  = 
124,  8  =  134.  Note  that  the  product  array  above  is  fractionated  using  I  =  +23459. 

Design  13-7.b  has  similar  structure:  x  26’2  J ,  with  each  16-run  sub-design 

divided  into  four  blocks  (see  Figure  2.3).  Butler  (2002a)  describes  these  types  of  designs 
as  joint  designs;  see  also  Miller  (1997). 
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Figure  2.2:  Design  Structure  for  9-4.2 


2j~2  with  ii  =  5610  and  13  =  5612  | 

6H  =  + 
61013  =  + 

6U  =  + 
61013  =  - 

6H  =  - 
61013  =  + 

611  =  - 
61013  =  - 

2  ]y  with 

7=123, 

8=124, 

9=134 

1=  + 
234  =  + 

4x4  =  16runs 

1  =  + 
234  =  - 

4x4  =  16  runs 

1  =- 
234  =  + 

4x4  =  16  runs 

1=- 
234  =  - 

4x4  =  16  runs 

Figure  2.3:  Design  Structure  for  13-7.b 
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3.  Projection  Design  Search  Method 

The  difficulty  of  finding  minimum  aberration  designs  (and  other  good  designs) 
increases  dramatically  as  the  size  of  the  designs  grows.  As  n  becomes  larger,  it  is  no 
longer  feasible  to  conduct  exhaustive  searches.  One  option  is  to  intelligently  reduce  the 
number  of  designs  that  must  be  investigated.  The  value  of  sos  designs  is  they  represent  a 
small  fraction  of  all  possible  resolution  IV  designs  and  project  to  all  the  remaining 
possible  resolution  IV  designs.  Thus  from  these  designs  one  can  project  to  minimum 
aberration  and  other  good  designs.  If  all  the  sos  designs  for  a  given  n  can  be  found  and 
identified,  then  we  have  the  starting  points  for  all  resolution  IV  even  or  even/odd  designs 
for  a  given  n. 

Our  first  attempt  to  find  minimum  aberration  and  other  good  designs  was  to  find 
all  the  sos  designs  for  a  given  run  size  n  and  then  project  from  those  designs  to  identify 
the  best  designs.  To  accomplish  this  requires  the  ability  to  find  sos  designs,  distinguish 
non-isomorphic  sos  designs,  and  then  to  determine  the  best  projections. 

The  first  issue  is  feasible  at  n  =  128.  It  appears  to  be  possible  to  find  the  sos 
designs  at  n  =  128.  Projections  of  these  sos  designs  lead  to  weak  minimum  aberration 
designs  and  careful  evaluation  of  all  sos  designs  would  determine  minimum  aberration 
for  any  k  <  64  at  n  =  128.  There  are  88  unique  sos  designs  at  n  =  128.  However  to  find 
the  minimum  aberration  design,  one  must  evaluate  all  possible  sequence  of  projections; 
this  combinatorial  problem  currently  becomes  computationally  infeasible  beyond  ten  or 
more  projections.  Therefore  the  projection  search  method  is  limited  in  its  usefulness  for 
conducting  an  exhaustive  search;  in  addition,  the  number  of  sos  designs  explodes  at 
higher  n.  For  instance,  there  are  at  least  34,015  (and  possibly  twice  that  many)  sos 
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designs  at  n  -  256  (see  section  13).  Thus  we  found  it  necessary  to  pursue  alternative 
methods. 


14 


4.  Detecting  Isomorphic  Designs 

To  successfully  find  minimum  aberration  designs  requires  a  computationally  fast  and 
efficient  method  to  find  and  compare  designs,  as  well  as  some  ability  to  quickly  identify 
isomorphic  designs. 

When  searching  for  designs,  most  of  the  time  is  spent  evaluating  isomorphic  designs. 
CSW  (1993)  were  not  able  to  distinguish  all  n  =  128  designs  beyond  k  =  1 1  because  of 
the  time  required  to  find  a  complete  relabeling  of  columns  for  every  isomorphic  design 
check.  At  n  -  128  with  k=\\  factors,  there  are  2,597  sets  of  four  generators  that 
produce  a  resolution  IV  designs.  Of  these  designs,  there  are  only  92  non-isomorphic 
designs.  This  is  the  last  step  CSW  completed  (Sun  2001).  Consider  at  k  =  17  we  have 
found  14,438  unique  resolution  IV  designs,  and  a  total  of  302,384  sets  often  generators 
producing  a  resolution  IV  design.  Thus,  on  average,  there  are  more  than  20  ways  to 
construct  each  unique  design  and  the  number  of  designs  to  compare  is  two  orders  of 
magnitude  greater. 

Two  fractional  factorial  designs  are  isomorphic  (Dl  s  Z)2 )  if  one  design  can  be 
obtained  from  the  other  design  by  relabeling  the  factors,  reordering  the  runs,  or  switching 
the  levels  of  factors  (Chen  and  Lin  1991).  Clark  and  Dean  (2001)  present  a  necessary 
and  sufficient  condition  for  two  designs  to  be  isomorphic  based  on  a  geometrical 
representation  of  the  designs.  Let  D  represent  an  nxk  design  matrix  with  n  runs,  k 

factors,  and  levels  ±1 .  Let  T(D  )  =  DU ,  which  is  related  to  the  Hamming  distance 
matrix  H,  since  T  =  kJk-2H  where  J  k  is  a  kxk  matrix  of  unit  elements.  Note  that  for 
any  design  D,  the  (/,;')*  element  of  T,  denoted  as  TtJ{D) ,  is  equal  to  the  inner  product  of 
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the  i  and  j  rows  of  D.  Clearly  Ty(D)  —  k  for  /  =  j .  Other  properties  of  T  are  discussed 

in  sections  five  and  six.  We  now  describe  a  result  from  Clark  and  Dean  (2001)  and 
introduce  more  notation: 

Clark  and  Dean's  Corollary  2.2:  Designs  Dl  and  D2  are  isomorphic  if  and  only  if 
there  exists  an  nxn  permutation  matrix  R  and  a  permutation  {cx,c2,...,ck}  of 

{1,2,.  ..,k}  such  that,  for  9=1,2,...,*:  T(DjhX''q))  =  RT(D2"C2'',C'})R'  where 
D{'x-’q)  denotes  a  ^-factor  subset  of  the  full  design  including  just  the  listed  columns. 

We  will  say  that  T{DX)  is  equivalent  to  T(D2)  [denoted  as  T(DX)  =  T(D2 )]  if  for 
some  permutation  matrix R ,  T(DX)  =  RT(D2)R' .  Define  D]q]  to  represent  the  design 
with  only  the  qA  column  from  D, .  Similarly,  D™  is  the  design  matrix  with  all  the 
columns  of  Z>  except  for  column  q.  Observe  that  Tv(D{q))  =(k-\)  for  i  =  j.  Based  on 
Clark  and  Dean's  Corollary,  we  have  Lemma  4.1 : 

Lemma  4. 1 :  D,  =  D2  if  and  only  if  T{DX)  =  T(D2 )  and  =  D2q)  for  some  integers 
q  and  cq . 


Note  that  by  Clark  and  Dean's  Corollary  2.2  D{k)  =  Dfi}  if  and  only  if  there  exists  R 
and  {Cj ,•  ■  }  such  that 

T(Df>)  =  RT(D2,})R\  T(Dfk &>)  =RT(D^)R',~.,T(D?))  =  RT(D™)R'.  Then 
Dx=D2,  if  and  only  if  T(D{)  =  T(D2 )  and  D\q)  =  D2q)  for  some  integers  q  and  cq . 
Lemma 4.2:  {T(D[i)),---,T(D{k))}  determines  T(D). 

We  show  this  result  for  an  arbitrary  element  Ty(D) .  Suppose  we  have  a  design 
D ,  with  k  factors  and  we  know  the  T matrices  for  the  k projections  {T(D{ll),---,T(Dik])} 
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for  D.  Define  r  =  TiJ^  +  k  .  Then  for  rvalues  of  /  =  1,2, •••,£,  T.j{D{l))  =  Tij{D)-\, 

and  for  k  -  r  values  of  /,  TiJ(Din)  =  Ty (D)  + 1 .  There  are  two  possibilities  for  Ty (D) : 

The  set  {TiJ(D{i]),--JiJ(D{I])}  will  contain  both  Ty(D)  - 1  and  Ty(D)  +  1  values,  in 
which  case  they  bound  Ty(D) ;  or  the  set  will  contain  one  constant  value,  in  which  case 
Ty(D)=  Ty(D{‘])  +  1  if  Ty{D{l})  is  positive,  or  Tij{D{l))  -  1  if  Ty(D{l})is  negative. 
Q.E.D. 

Lemma  4.2  states  that  the  set  of  determines  T(D).  If  we 

are  missing  one  of  the  projections  from  that  set,  we  can  still  determine  T(D) . 

Corollary  4.1:  k-  1  members  from  {T(D{Vl),---,T(D[k))}  determine  T(D) . 

The  proof  is  as  follows:  Suppose  we  have  design  Dt ,  with  k  factors  and  we  know 

k- 1  of  the  members  from  {T(D{1)),~-,T(D{k])} .  Tg(Dm)  will  either  increase  or 


decrease  die  value  of  Tiy{D)  by  one.  Recall  that  r  = 


TyiPy± 

2 


and  for  r  values  of 


l  =  \,2,-,k,  Ty(D{I])  =  Ty(D)  - 1 ,  and  for  £  -  r  values  of  / ,  Ty(D{i])  =  Ty(D)  +  l.  If  we 
are  missing  one  projection,  we  can  still  determine  Ty(D) .  There  axe  two  possibilities  for 
Ty(D) :  The  set  will  contain  both  Ty{D)  -  1  and  Ty(D)  +  1  values,  in  which  case  they 
bound  Ty(D) ;  or  the  set  will  contain  one  constant  value,  in  which  case  Ty(D)=  Ty(D{l]) 
+  1  if  Ty(D{I})  is  positive,  or  Ty(D{l) )  -  1  if  Ty(D{l}) is  negative. 
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Now  we  make  two  conjectures  regarding  isomorphism  of  two  designs  based  on 
isomorphism  of  their  delete-one-factor  projections.  Let  D\  and  Z>2  be  any  regular  2k'p 
designs  with  no  repeat  rows  (runs). 

.Con lecture  4. 1 :  If  D\,]  =  D2‘  *  with  i  =  \,2,---,k ,  where  {c, , c2 , •  •  • , ck }  is  any  permutation 
of  the  integers  {1,2  ,•••,£} ,  then  Z),  =  Z)2 . 

We  know  under  the  following  conditions  that  the  conjecture  is  true:  Note  that 
T(D >;T» )  +  •••  +  T(Df] )  =  (k- 1  )T(Dt )  and  7(D'T) )  +  •••  +  T(D?' )  =  (k- \)T(D2 ) . 
Without  loss  of  generality,  assume  the  columns  of  Z)2  are  ordered  such  that 
A*'1  =  A!'*  •  Then  there  exists  an  9  7’(D1<,,)  =  /?)7,(Dji,)/?|.'.  If  -  ■■■-  Rk  =/? 

then  7’(A‘i})  =  i?7,(Df)/?'V/  and  ^r(D',T()  =  )i?' .  Then 

(k-\)T(Dl)  =  (k-\)T(D2).  Thus  T(Dl)  =  T(D2) and  D,  sD2. 

The  key  requirement  of  the  conjecture  is  that  s  {£>f } }  for  i  =  I,---,* 
implies  T{DX)  s  T(D2).  We  know  this  requirement  is  not  true  in  general.  In  fact,  we 
know  that  a  non-simple  design  may  share  the  same  set  of  projections  as  a  simple  design, 
but  will  have  a  different  T matrix.  For  example  consider  the  24  full  factorial  design  and 
the  replicated  2IV  fractional  factorial  design.  While  they  share  the  same  projections, 
they  have  different  T  matrices. 

Define  S  <=  {1,2,-  -,Ar}  with  cardinality  ^ .  If  Conjecture  4.1  is  true,  then  we 
suppose  that  the  following  stronger  conjecture  may  also  be  true. 

Conjecture  4.2  If  two  designs  Z),  and  D2 ,  have  s  projections  in  common,  and  these  s 

projections  of  Z), ,  {Z>,{7}  :ieS}  determine  T(D,) ,  then  Z),  =  Z)2 . 
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Assume  we  have  two  designs,  D1  and  D2 ,  with  5  projections  in  common, 

Dp  =  Dp]  for  i  e  S .  If  the  5  projections  of  Dx ,  {D'p  :ieS }  determine  T(DX),  then 
they  also  determine  T(D2 )  and  we  suppose  D,  =  D2 . 
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5.  Advantages  and  Uses  of  the  T  Matrix 

Hedayat,  Sloane,  and  Stufken's  definition  3.4  (1999)  states  that  an  orthogonal 
array  OA(N,  k,  2,  t )  with  levels  from  GF(2)  is  said  to  be  linear  if  it  is  simple  (runs  are 
distinct)  and  if,  when  considered  as  A>tuples  from  GF(2),  its  N  runs  form  a  vector  space 
over  GF(2)  (i.e.,  satisfy  the  condition  that  if  Rj  and  R2  are  any  two  runs  of  the  array  then 
every  ft-tuple  C]Ri  +  c2R2  is  also  a  run,  for  any  choice  of  c\,  c2  e  GF( 2)). 

It  is  known  that  all  two-level  regular  fractional  factorial  designs  are  OA(N,  k,  2,  t) 
with  t  =  (resolution  -  1).  All  regular  fractional  factorial  designs  without  repeat  runs  are 
simple.  Fractional  factorial  designs  with  a  defining  relation  (regular  design)  are  a 
subclass  of  orthogonal  arrays  and  are  linear  codes  (Hedayat,  Sloane,  and  Stufken  p.276). 
Therefore  we  can  take  the  sum  of  any  two  rows  from  a  regular  fractional  factorial  design 
and  using  modulus(2)  arithmetic  it  will  equal  another  row  in  the  design.  Note  that  the 
element-wise  product  for  two  runs  with  levels  ±1  is  equivalent  to  modulus(2)  arithmetic 
for  the  same  two  runs  with  levels  0  and  1 .  Hence,  for  regular  two  level  fractional 
factorial  design  with  levels  of  ±1 ,  any  two  rows  multiplied  element-wise  will  result  in 
another  row  of  the  design. 

For  example  consider  a  2*“2  regular  fractional  factorial  design  where: 

-1  -1  -1  -1  1 
-1-111  -1 
-11-111 
D=  - 1  1  1  -1  -1 

1-1-1  1  -1 
1-1  1-1  1 
1  1-1-1  -1 
11111 
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and  the  T  matrix  is: 


T(D)  =  DD'= 


5  -1 
-1  5 

1  -1 
-1  1 

-1  1 
1  -1 
-1  -3 
-3  -1 


1  -1 
-1  1 
5  -1 
-1  5 

-1  -3 
-3  -1 
-1  1 
1  -1 


-1  1 
1  -1 
-1  -3 
-3  -1 
5  -1 
-1  5 

1  -1 
-1  1 


-1  -3 
-3  -1 
-1  1 
1  -1 
1  -1 
-1  1 
5  -1 
-1  5 


Note  that  each  column  (and  row)  of  Thave  the  same  distribution  of  values.  For 
instance,  each  column  contains  the  values  -3,  -1, 1,  and  5  with  frequencies  1, 4, 2,  and  1, 
respectively. 

Theorem  5.1:  Any  two-level  regular  factorial  design  D  will  have  a  constant  column 
distribution  in  T(D) . 

We  now  show  that  the  elements  of  tf  are  a  permutation  of  the  elements  of  tf  for 
arbitrary  /and  j  from  {1, ...,  n}.  We  know  that  xtXj  =  for  some  /  e  {1, 2 ..... n) ,  where 
xtXj  is  defined  as  the  element-wise  product  of  the  Ith  and/1  rows.  Hence,  xixl  =  x} . 


Now  define  tf  =D-  Xj  where  xf  is  the /  row  of  D ,  and  rewrite  tf  = 


X{Xj 


XJ 


using  the 


specified  /th  and fh  rows  above  as  tf  = 


V  (*/*/) 

"(WV 

(xmx,yx,_ 

From  the  definition  of 


a  group  we  know  that  any  element  from  a  group  multiplied  by  the  group  results  in  the 
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(*!*/)'*, 

original  group.  Therefore  this  implies  that  the  matrix  =  :  contains  all  the 

elements  of  tf .  Q.E.D. 
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6.  Functions  of  the  T  Matrix 


We  know  from  Theorem  5.1  that  t° ,  •••,  tDn  are  simply  different  permutations  of 
the  same  vector.  Butler  (2003)  states  that  Ty(D)  measures  the  confounding  between  the 

f  and  f  rows.  He  defines  nk  =  0°)  as  the  ^  moment  of  the  elements  of 

i=l  }= i 

the  T  matrix.  Therefore,  the  moments  ■ • ,  nk  provide  an  overall  measure  of  the 

confounding  between  rows  of  the  design  (Butler  2003).  By  Theorem  5.1  we  can  use  any 
one  column  of  the  T  matrix  to  calculate  the  moments  of  a  regular  design.  When  our  use 
of  tj*  does  not  depend  on  the  subscript  i ,  we  simply  write  tD  to  represent  an  arbitrary 

column  of  T.  We  know  from  Butler  (2003)  that  the  design  moments  for  D  can  be  used 
to  compare  and  rank  designs.  The  design  moments  method  results  in  an  identical  ranking 
of  designs  that  results  from  using  the  word  length  pattern  for  designs  (Butler  2003). 

Since  the  word  length  pattern  and  moments  of  T  are  both  functions  of  t  ,  it  is  possible 
that  tD  might  be  more  discriminating  than  the  moments  of  a  design  or  equivalently  the 
word  length  pattern.  However;  by  Theorem  6.1,  the  frequencies  of  tD  can  be  written  as  a 
function  of  the  moments,  so  tD  is  no  more  discriminating  than  is  the  word  length  pattern. 
Let  represent  the  frequency  of  values  for  -k,{-k  +2), ... ,  k, 

respectively,  in  tD . 

Theorem  6.1:  The  frequencies  /0, ...,/*  are  a  function  of  the  moments 

k 

We  can  write  n//y  =^(2 i-k)J  ft  for  j  e  {0,1, — , A:} 

i=0 
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Note  that:  n/u0  -  ^(2 i-k)°  ft  -  =n .  Define  //y'=  fjn  and  let 

i=0  1=0  |=0 

>0*1 

:  .  Note  that  M  ~  BM  where  B  is  a  lower  triangular  matrix 

x. 

with  positive  values  on  the  diagonal  since  /ur  =  E[ 2i  -  it]  r=  2  rE[ir  ]  -  2r_1  rkE[ir~]  ]  + 

—  2  Mr  ~ 2  r^Mr- 1  "*■••••  We  know  that  the  determinant  of  a  triangular  matrix  is  equal  to 

the  product  of  the  elements  along  the  diagonal  (Eves,  pi  23).  Hence,  M*  =  B~' M  since 
the  matrix  B  is  nonsingular  and  can  be  inverted. 


Now  write  the  moments  of  a  design,  //0, •••,//*,  as  a  system  of  equations 


nM  -AF  where  F  =  :  and  the  coefficient  matrix  A  is: 


11  1  1  ...  1 
0  1  2  3  ...  k 

0  1  22  32...  it 2 

•  •  #  •  • 

*  •  ♦  «  # 

*  #  •  •  # 

0  1  2*  3*  •••  it* 

The  determinant  of  matrix  A  can  be  described  as  a  Vandermonde  determinant  (Eves 
p.  127).  From  this  literature,  it  is  known  that  A  is  nonsingular  (since  the  values  of  A  are 
integer  and  increasing  [0, 1,  ...,k]).  Thus ,4  can  be  inverted,  so  we  can  rewrite  our  system 
of  equations  in  terms  of  F=A~'nM *  and  F  =  nA-'B-'M .  This  means  the  frequencies, 
F,  are  a  function  of  the  moments  M.  Therefore  the  probabilities  that  generate  those 


moments  are  unique  and  the  moments  are  unique  in  the  sense  that  any  two  designs  with 
the  same  moments  M  must  have  identical  tD  frequencies  F. 

Since  word  length  pattern,  or  equivalently  tD ,  is  unsuccessful  in  distinguishing 
many  designs  at  n  =  64  and  larger,  we  are  interested  in  creating  a  more  discriminating 
function  from  pairs  of  columns  of  T.  Let  T2D  represent  the  set  of  n  pairs  of  columns  of 
T for  D  where  T2°  = 

Define  G(T2D)  =  {g(t?  ,t°)} ,  where  g{tx ,t°)  =  YJh(TrXTn) 

r-\ 

and  h(x)  =  0  when  x  <  0 , and  h(x)  =  x~l  when  x  >  0 .  For  example,  consider  the  2)f 

regular  design  again.  The  tD  vector  contains  the  values  -3,  -1, 1,  and  5,  with  frequencies 
1, 4, 2,  and  1,  respectively.  Figure  6.1  shows  the  four  bivariate  frequency  distributions 
that  occur  for  the  pairs  of  columns  for  T.  While  the  columns  of  Thave  identical 
frequency  distributions,  the  pairs  of  columns  for  T  do  not.  For  the  n  pairs  (tj° ,  tf) 
j  =  1,2, •••,«,  four  possibilities  occur  with  frequencies  1, 4,  2,  and  1,  respectively  (see 
Figure  6.1).  Therefore,  G(T2°)=  {6.1511, 0.667, 4.4, 0.667, 0.667, 4.4, 0.667, 6.0}  for 
this  design.  We  sort  this  set  for  our  convenience  in  comparing  designs  so  that  G(T2°)  = 
{0.667,  0.667, 0.667,  0.667, 4.4, 4.4,  6.0,  6.151 1}. 

We  chose  to  define  T2°  above  pairing  each  of  the  n  columns  of  T  with  tf .  We 

now  show  that  the  set  G(T2° )  is  invariant  to  the  choice  of  which  column  we  fix. 

Lemma  6.1:  For  any  i  e  (1, •••,«) ,  j  =  =  {$(*?,*£)  j  =  where 

( r\,-'-,rn )  is  a  permutation  of  (!,•••,«). 
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(\,j)  Pairs  of 
T matrix  columns: 


Bivariate  distribution: 
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Without  loss  of  generality,  assume  xn  is  the  treatment  combination  with  all  +1 
levels.  Then  the  element-wise  product  of  xtxy  =  x„xrj  =  xrj  for  some  ry  e  {1, •••,«} . 
Hence,  Lemma  6.1.  By  this  lemma,  {g(tf , tf  )  j  =  1, ■ • •  ■ • ,  n}  is  invariant  to  the  choice  of  i . 

We  defined  T2°  with  i  =  1. 

Theorem  6.2:  D1=D2=>  G(T2°l  )  =  G(T2°2 ) 

Since  Dx  =  D2 ,  there  exists  {r, ,  •  •  • ,  rn }  ,  a  permutation  of  {1,  •••,«} ,  such  that 
T(D} )  =  RT(D2 )R'  where  R  is  the  permutatin  matrix  defined  as  Ry  =1  if  j  =  rt ,  and 

zero  otherwise.  Then  (t®'  ,t^ )  =  (Rt®2  ,Rt®2 )  for  j  =  (1, ...,  n).  So 
g(t^  ,tf' )  =  g(t®2,t®2 )  for  j  =  (1, ...,  n),  because  the  permutation  matrix  R  does  not 
affect  the  computation  of  g(y)  since  we  are  summing  the  rows.  Then  by  Lemma  6.1, 
{g(t®2,t®2)  j  =  \,-,n}  =  G(T2D2)  and  so  G(T2D' )  =  G(T2°2 ) .  Q.E.D. 

The  set  G(T2°)  uniquely  identifies  all  regular  resolution  IV  designs  for  n  <  128. 
At  n  =  128,  G(T2°)  uniquely  identifies  296,958  of  the  296,960  even/odd  designs  (it  does 
not  uniquely  identify  2  even/odd  designs)  which  differ  based  on  their  delete-one-factor 
projections.  However,  it  does  distinguish  the  two  2^u  regular  designs  that  are 

commonly  cited  from  Chen  and  Lin  (1991)  as  an  example  of  non-isomorphic  designs 
with  common  letter  pattern  matrices.  See  Section  1 1  for  more  comparisons  with  other 
common  criterion. 
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7.  Exhaustive  Even/Odd  Design  Search  Method 

We  now  present  a  new  method  for  finding  minimum  aberration  designs  using  a 
build  up  and  delete-one-factor  projection  strategy.  As  noted  previously,  CSW  were 
unable  to  fully  enumerate  designs  beyond  k  =  1 1  at  n  =  128,  due  to  the  enormous 
computations  required  to  perform  their  isomorphism  checks.  Our  approach  for  regular 
factorial  designs  attempts  to  take  advantage  of  a  simplified  isomorphism  check.  Using 
Conjecture  4.1  we  replace  the  permutation  check  for  isomorphism  from  Clark  and  Dean 
and  check  the  set  of  delete-one-factor  projections  for  each  design.  We  save  only  the 
unique  sets  of  delete-one-factor  projections  and  the  G(T2°)  set,  thus  determining  our 
non-isomorphic  designs. 

If  Conjecture  4.1  is  not  true,  then  there  could  exist  designs  with  non-equivalent  T 
matrices  that  have  a  common  set  of  delete-one-factor  projections.  We  differentiated 
designs  based  on  their  delete-one-factor  projections.  We  did  not  check  G(T2° ) 
simultaneously  with  the  delete-one-factor  projections  and  therefore  did  not  have  the 
occasion  to  find  any  designs  with  isomorphic  delete-one-factor  projections  but  different 
sets  of  G(T2d ) ,  which  would  provide  a  counter-example  to  Conjecture  4.1  for  n  =  128. 

The  approach  is  as  follows:  begin  with  all  non-isomorphic  resolution  IV  designs 
with  k  factors.  Consider  all  possible  k  +  1  factor  designs  obtained  by  adding  a  generator 
to  each  k  factor  design.  We  then  check  the  k  +  1  delete-one-factor  projections.  If  the  k  + 
1  delete-one-factor  projections  for  design  Dx  are  equal  to  the  it  +  1  one-factor  projections 
for  Z)2  then  the  designs  are  considered  isomorphic  by  Conjecture  4. 1 ;  otherwise  they  are 
non-isomorphic.  This  process  can  be  repeated  as  we  increase  k  by  one  factor  at  a  time. 
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Using  this  approach  allowed  us  to  complete  an  "exhaustive"  search  of  even/odd  designs 
at «  =  128  for  A:  <  40 . 

Another  step  to  reduce  the  computational  burden  at  n  =  128  was  the  elimination  of 
the  requirement  to  retain  even  designs  past  k  —  22.  This  was  possible  for  the  following 
reasons.  Resolution  IV  2k~p  even/odd  designs  project  to  a  set  of  k-m 
even/odd  designs  and  m  isomorphic  2(*"1)~(p"l)even  designs  (by  Lemma  2.1),  where  m  is 
defined  as  the  multiplicity  for  the  number  of  delete-one-factor  projections  from  a 

2k~p  design  that  project  to  a  2(*_1)_(p~1)  even  design. 

We  classify  m  into  three  cases:  When  m  —  0,  the  set  of  k  projections  are  all 
2(*-i)-0>-i)  even/0(id  designs  and  by  Lemma  4.2  we  can  determine  T(D) .  When  m  =  1, 
we  use  Conjecture  4.2,  motivated  by  Corollary  4.1  and  the  set  of  k-  1  even/odd 
2(*-d-(p-i)  designs  to  determine  D.  The  last  case,  when  m  >  1,  is  determined  as  follows: 
We  know  k-m  projections  are  2a“1)_(p‘l)  even/odd  designs  and  m  projections  are 
isomorphic  2(*~1)_(p~l)  even  designs.  Without  loss  of  generality,  suppose  D{,)  i  = 
are  2(*~1)-^"^  even  designs,  and  the  remaining  k-m  projections  are  2(*"1)_^"^  even/odd 
designs.  Then  G(T2dW ),  m,  and  D{i}  ( i>m )  determine D  (up  to  isomorphism).  The 
reason  is  as  follows:  for  n  =  8, 16,  32,  and  64,  we  know  that  G(T2°)  uniquely 
distinguishes  all  2kwp  designs.  For  n  =  128,  even  2^’Hp_1)  designs  projected  from 
2 \~p  designs  with  m  >  2 ,  permit  us  to  distinguish  D  by  G(T2°)  since  the  even 
2(*-i)-(p-i)  designs  can  be  written  as  the  product  array  21  x  2<t~2)“(p~1)  and  so  all  are 
uniquely  distinguished  by  G(T2D) . 
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8.  Resolution  IV  Designs  of  Size  128 

We  characterize  the  even/odd  resolution  IV  design  for  n  =  128  using  five 
criterion: 

•  wlp  (minimum  aberration) 

•  Maximum  degrees  of  freedom  used  for  main  effects  and  two-factor  interactions 

•  Minimium  Lmax  (the  length  of  the  longest  two-factor  interaction  alias  chain) 

•  Maximum  number  of  clear  two-factor  interactions 

•  Minimum  CD2  (the  unique  portion  of  the  centered  L2  discrepancy  from  Ma, 

Fang,  and  Lin  2001). 

The  minimum  aberration  designs  for  k  <  40  at  n  =  128  are  listed  in  Table  8.1  along  with 
the  above  criteria  and  their  respective  ranking.  The  complete  alp  is  also  provided  for 
each  design.  Appendix  C  contains  a  catalog  of  the  best  even/odd  designs  and  their 
rankings  for  k  =  8, . . .,  40  with  respect  to  our  various  criteria. 

Our  exhaustive  search  of  even/odd  designs  found  not  only  the  minimum 
aberration  designs,  but  also  a  number  of  interesting  results.  All  minimum  aberration 
designs  from  10  <  k  <  40  are  even/odd  designs.  We  found  that  the  uniform  centered 
design  criteria  (Ma,  Fang,  and  Lin  2001)  is  closely  related  to  the  word  length  pattern. 

Our  calculation  of  the  minimum  CD2*  value  agreed  with  the  minimum  aberration  design 
in  all  but  four  cases;  in  those  cases,  the  minimum  aberration  value  was  the  second 
smallest  CD2*  value. 
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No  minimum  aberration  designs  have  any  clear  two-factor  interactions  beyond 
k  =  23,  although  we  found  designs  with  clear  two-factor  interactions  up  to  k  =  33.  We 
know  from  Chen  and  Hedayat  (1998)  that  designs  with  clear  two-factor  interactions  exist 
only  if  k  <  m/4  + 1 .  In  general,  as  the  number  of  factors  increases,  the  number  of  good 
designs  (based  on  word  length  pattern)  with  clear  two-factor  interactions  decreases. 

There  exist  296,960  even/odd  non-isomorphic  resolution  IV  (or  higher)  designs 
for  n  =  128  (see  Table  8.2).  There  are  also  88  resolution  IV  sos  designs,  and  all  but  one 
of  the  sos  designs  are  even/odd  designs.  We  also  now  know  that  sos  designs  may  have 
the  same  word  length  patterns  but  different  alp  and  may  even  share  the  same  word  length 
pattern  as  other  non-sos  designs.  For  instance,  consider  the  three  designs  at  k  =  33,  where 
the  two  sos  designs  33-26.42b  and  33-26.42c  share  identical  word  length  patterns  with 
design  33-26.42a  which  is  not  an  sos  design.  All  three  designs  have  different  alias  length 
patterns. 

We  also  found  two  notably  good  sos  designs:  k  =  29,  and  k  =  40.  The  design  at  k 
=  40  is  well  known  and  many  of  its  projections  lead  to  other  minimum  aberration 
designs.  The  sos  design  at  k  =  29  has  a  remarkably  smaller  number  of  length-four  words 
than  any  other  k  =  29  design  and  several  of  the  sos  design's  projections  are  also  minimum 
aberration  designs.  In  particular,  the  minimum  aberration  designs  can  be  found  by 
projecting  from  sos  designs  at  k  =  29  or  k  =  40  for  k  =  40, 39,  ...,26,24, 16, 13,  11, 10, 
and  9  (see  Section  12). 

It  is  interesting  to  note  that  for  k  <  40 ,  the  minimum  aberration  design  word 
length  pattern  for  each  k  is  indeed  unique,  which  supports  the  conjecture  that  the  word 
length  pattern  is  unique  for  minimum  aberration  resolution  IV  designs.  In  fact,  only 


32 


Table  8.2;  Existence  of  Resolution  IV*  designs 


k 

#  of  even/odd 

#  of  even 

#  of  even/odd 

#  of  even 

designs, 

designs, 

designs, 

designs, 

n  =  64 

h  =  64 

n  =  128 

n=  128 

7 

2 

2 

- 

- 

8 

3 

4 

2 

3 

9 

6 

6 

7 

6 

10 

12 

12 

19 

14 

11 

20 

14 

62 

30 

12 

22 

21 

180 

69 

13 

24 

23 

487 

136 

14 

20 

29 

1,240 

295 

15 

15 

29 

2,926 

596 

16 

11 

37 

6,208 

1,292 

17 

10 

30 

11,787 

2,651 

18 

3 

30 

19,466 

5,598 

19 

1 

24 

27,994 

11,341 

20 

1 

23 

35,192 

22,728 

21 

_ 

16 

39,201 

43,516 

22 

15 

38,847 

79,603 

23 

- 

9 

34,868 

? 

24 

_ 

8 

28,133 

? 

25 

_ 

5 

20,569 

? 

26 

- 

4 

13,498 

? 

27 

- 

2 

8,075 

? 

28 

_ 

2 

4,284 

? 

29 

- 

1 

2,149 

? 

30 

- 

1 

976 

? 

31 

- 

1 

433 

? 

32 

- 

1 

197 

? 

33 

- 

- 

101 

? 

34 

- 

- 

31 

? 

35 

- 

- 

13 

? 

36 

- 

- 

8 

? 

37 

- 

- 

3 

? 

38 

- 

- 

2 

? 

39 

- 

- 

1 

? 

40 

_ 

- 

1 

? 
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at  k  =  3 1 ,  does  one  have  to  go  beyond  length-5  words  in  the  defining  relation  to 
differentiate  minimum  aberration  designs  from  weak  minimum  aberration  designs. 

Finally,  the  Lmax  results  show  that  it  is  impossible  to  create  an  n  =  384  %-design 
(John  1962)  for  k  >  20  from  resolution  IV  fractions,  since  Irnax  >  3.  Also  many  of  the 
better  designs  based  on  word  length  pattern  are  also  ranked  in  the  best  designs  according 
t°  A™  •  For  example,  the  top  eight  designs  based  upon  word  length  pattern  are  also  the 
top  eight  ranked  designs  for  Lmax  at  it  =  1 8. 
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9.  Incomplete  Enumeration  of  Designs  Based  on  Word  Length  Pattern 

As  the  size  of  n  increases,  more  and  more  computer  resources  are  required  to  fully 
enumerate  designs.  The  next  two  sections  explore  computationally  simpler  (imperfect) 
isomorphism  checks  in  order  to  evaluate  their  potential  merit  for  n  =  256  and  beyond. 

Butler  developed  an  algorithm  using  a  flawed  isomorphic  rule  based  on  the 
moments  of  the  designs  (word  length  pattern)  that  starts  with  a  basic  set  of  factors  and 
then  adds  one  generator  at  a  time  to  construct  new  designs.  He  describes  his  approach  as 
follows: 

"The  iterative  algorithm  uses  all  the  designs  with  distinct  wordlength  patterns  (or 
equivalently,  distinct  T  moments)  for  k  factors  and  adds  an  extra  factor  to  each  to 
form  designs  for  k  +  1  factors.  Only  designs  with  distinct  wordlength  patterns  are 
retained  for  die  next  stage  of  the  algorithm.  At  each  stage,  the  wordlength  pattern 
is  determined  from  the  elements  of  T.  The  algorithm  does  not  recognize  that  on 
rare  occasions  designs  with  the  same  wordlength  pattern  are  not  necessarily 
isomorphic.  However,  a  design  for  k  factors  can  be  formed  from  any  of  the  k 
projections  involving  k—  1  factors  and  so  designs  are  highly  unlikely  to  be  lost 
altogether."  (Butler  2002b) 

Using  Butler's  methodology,  we  were  able  to  easily  search  for  even/odd  resolution  IV 
designs  using  Matlab  version  6.5  on  a  Pentium  III  and  IV  computer. 

Our  program  constructed  a  full  factorial  in  seven  basic  factors  for  n  =  128  runs 
and  then  constructed  a  generator  matrix  of  all  possible  generators  (based  on  the  120 
different  interactions  involving  the  basic  columns).  We  then  started  with  the  seven  basic 
factors  and  added  one  generator  at  a  time.  We  calculated  tD  for  each  design  and  retained 
only  one  design  for  each  distinct  tD  vector.  This  method  does  not  distinguish  between 
non-isomorphic  designs  with  identical  design  moments  (word  length  patterns).  In  our 
implementation,  this  method  was  successful  in  finding  all  minimum  aberration  designs 
except  at  k  =  24,  where  we  found  only  the  weak  minimum  aberration  design.  In  general, 
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we  lost  about  two  percent  of  the  word  length  patterns  using  this  approach  at  n  =  128  runs 
(see  Table  10. 1).  However,  we  only  identified  20%  of  the  even/odd  designs  that  exist. 
Thus  having  non-isomorphic  designs  with  the  same  wlp  is  a  very  common  occurrence  at 
n  =  128.  For  example,  the  word  length  pattern  (0, 0, 0,  8, 34, 42, . . .)  at  k  =  1 5,  occurs  for 
four  designs  (see  p.  106).  Another  word  length  pattern  (0, 0, 0, 21, 0,  80, ...)  at&=  15, 
occurs  for  48  non-isomorphic  designs. 
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10.  An  Improved  Imperfect  Isomorphic  Rule  Approach 

In  an  effort  to  find  a  more  discriminating  function  than  tD  (or  equivalently,  wlp) 
for  our  imperfect  isomorphic  rule  approach  to  determining  isomorphic  designs,  we  turned 
to  the  G(T2d)  vector.  G(T2°)  uniquely  determined  the  same  designs  cataloged  by  Sun 
(2001)  and  CSW  (1993)  for  n  =  128  and  k  =  8, 9, 10, 1 1  as  well  as  all  designs  at  n  =  64. 
Although  we  know  that  several  non-isomorphic  designs  do  have  identical  G(T2°)  sets, 
this  happened  in  only  rare  instances  (see  Table  10.1).  This  means  that  only  those  designs 
with  unique  G(T2°)  vectors  are  kept  as  we  sequentially  build  up  our  designs.  While 
this  method  does  miss  some  designs,  the  G(T2D )  vector  is  much  more  discriminating 
than  tD . 

The  empirical  results  at  n  =  128  show  that  the  designs  that  were  lost  were  not  the 
better  designs  in  terms  of  word  length  pattern,  and  that  although  a  few  (57)  non¬ 
isomorphic  designs  were  missed,  other  designs  with  identical  word  length  pattern,  alias 
length  pattern,  and  number  of  clear  two-factor  interaction  effects  were  found. 

Table  10.1  lists  the  number  of  even/odd  designs  found  using  several  different 
isomorphic  checks  for  n  =  128  and  £  <40.  We  show  the  number  of  even/odd  designs 
found  using  the  word  length  pattern  as  a  simple  but  flawed  isomorphic  rule,  and  the 
number  of  even/odd  designs  found  using  G(T2°)  as  a  flawed  isomorphic  rule.  We  also 
show  the  complete  enumeration  of  all  even/odd  designs  and  the  number  of  unique  word 
length  patterns  that  exist  among  the  exhaustive  list  obtained  based  on  delete-one-factor 
projections.  We  also  provide  percentages  of  designs  found  using  the  different 
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Table  10.1:  Comparison  of  Methods  for  Finding  Even/Odd  Resolution  IV*  Designs 


k 

#  of  e/o 
designs  by 
projections 

#  of  unique 
e/o  wlp  by 
projections 

tD 

#  of  e/o 
designs 
found 

%  found 
of  e/o 
unique 
wlp 

%  found 
of  total 
e/o 

designs 

G(T2d), 

#  of  e/o 
designs 
found 

%  found 
of  total 
e/o 

designs 

8 

2 

2 

2 

100 

100 

2 

100 

9 

7 

7 

7 

100 

100 

7 

100 

10 

19 

18 

18 

100 

94.7 

19 

100 

11 

62 

48 

48 

100 

77.4 

62 

100 

12 

180 

118 

118 

100 

65.6 

180 

100 

13 

487 

243 

243 

100 

49.9 

487 

100 

14 

1,240 

448 

444 

99.1 

35.8 

1,240 

100 

15 

2,926 

777 

765 

98.5 

26.1 

2,925 

99.9 

16 

6,208 

1,278 

1,257 

98.4 

20.2 

6,208 

100 

17 

11,787 

1,996 

1,946 

97.5 

16.5 

11,787 

100 

18 

19,466 

2,890 

2,825 

97.8 

14.5 

19,466 

100 

19 

27,994 

4,051 

3,937 

97.2 

14.1 

27,993 

99.9 

20 

35,192 

5,211 

5,109 

98 

14.5 

35,192 

100 

21 

39,201 

6,237 

6,086 

97.6 

15.5 

39,201 

100 

22 

38,847 

6,546 

6,422 

98.1 

16.5 

38,847 

100 

23 

34,868 

6,361 

6,226 

97.9 

17.8 

34,868 

100 

24 

28,133 

5,656 

5,578 

98.6 

19.8 

28,133 

100 

25 

20,569 

4,709 

4,629 

98.3 

22.5 

20,569 

100 

26 

13,498 

3,575 

3,516 

98.4 

26.0 

13,498 

100 

27 

8,075 

2,611 

2,547 

97.5 

31.5 

8,075 

100 

28 

4,284 

1,720 

1,691 

98.3 

39.5 

4,284 

100 

29 

2,149 

1,119 

1,099 

98.2 

51.1 

2,149 

100 

30 

976 

632 

620 

98.1 

63.5 

976 

100 

31 

433 

340 

332 

97.6 

76.7 

433 

100 

32 

197 

177 

175 

98.9 

88.8 

197 

100 

33 

101 

90 

90 

100 

89.1 

101 

100 

34 

31 

30 

30 

100 

96.8 

31 

100 

35 

13 

13 

13 

100 

100 

13 

100 

36 

8 

8 

8 

100 

100 

8 

100 

37 

3 

3 

3 

100 

100 

3 

100 

38 

2 

2 

2 

100 

100 

2 

100 

39 

1 

1 

1 

100 

100 

1 

100 

40 

1 

1 

1 

100 

100 

1 

100 

38 


approaches.  In  no  cases  did  the  sets  of  delete-one-factor  projections  fail  to  distinguish 
designs  with  different  tD  or  G(T2D) . 
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11.  Interesting  Designs  of  Size  128 

While  letter  pattern  and  G{T2°)  are  more  discriminating  than  wlp,  neither  is 
universally  more  successful.  For  example,  at  k  =  11  we  found  non-isomorphic  designs 
with  distinct  G(T2D)  values  and  identical  letter  pattern  matrices,  while  at  k  =  15  we 
found  non-isomorphic  designs  with  identical  G(T2°)  (and  identical  bivariate 
distributions)  but  distinct  letter  pattern  matrices. 

During  the  exhaustive  search  for  designs,  a  number  of  interesting  designs  were 
encountered  in  trying  to  determine  non-isomorphic  designs.  We  describe  four  problem 
cases  of  interest.  Below  is  a  sample  of  some  of  the  designs  encountered  along  with  a 
short  description  of  the  designs  and  their  properties. 

Problem  Case  1 : 

The  first  case  occurs  at  k  =  11.  Let  pci  la,  pci  lb,  and  pci  lc  represent  the  three 
problem  designs.  All  three  even/odd  designs  have  the  same  word  length  pattern  and  the 
same  alias  length  pattern.  The  first  design,  pclla,  has  a  different  letter  pattern  matrix 
than  pci  lb  and  pci  lc.  The  other  two  designs,  pci  lb  and  pci  lc,  have  identical  letter 
pattern  matrices.  All  three  designs  have  unique  G(T2°)  values.  Table  11.1  lists  the 
generators  for  these  designs. 


Table  11.1:  k  =  ll,j<  = 

Design  Generators 
pclla  7  25  43  116 

pci  lb  7  45  56  91 

pci  lc  7  56  77  91 


128  Problem  Designs 
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Problem  Case  2: 


The  second  case  occurs  at  k  =  1 5.  These  even/odd  designs  have  identical 
G(T2d)  values,  identical  word  length  patterns,  and  identical  alias  length  patterns. 
However,  the  letter  pattern  matrix  for  each  design  is  different.  Table  1 1.2  lists  the 
generators  for  these  designs. 


Problem  Case  3: 

The  third  case  occurs  at  £  =  16.  There  are  18  pairs  of  designs  that  have  various 
G(T2d)  values.  Each  pair  of  designs  also  have  identical  word  length  patterns  and 
identical  letter  pattern  matrices  respectively.  The  designs  do  have  different  alias  length 
patterns.  The  first  four  designs  listed  below  are  even/odd  designs  (al  through  b2)  and  the 
remaining  designs  are  even.  Table  1 1 .3  lists  the  generators  for  these  designs. 


Table  11.2:  k=\5,n  =  128  Problem  Designs 

Design  Generators _ 

pc 15a  7  11  19  38  59  73  100  120 
pc  15b  7  11  19  38  62  73  97  120 
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Table  11.3;  k  =  16,  n  =  128  Problem  Designs 
Design  Generators  _ 


pclbal 

7 

11 

19 

41 

52 

61 

74 

101 

120 

pcl6a2 

7 

11 

19 

35 

61 

62 

73 

85 

120 

pcl6bl 

7 

11 

21 

38 

57 

73 

82 

93 

120 

pcl6b2 

7 

11 

19 

38 

57 

73 

84 

93 

120 

pcl6cl 

7 

11 

21 

26 

31 

112 

121 

122 

124 

pcl6c2 

7 

11 

21 

25 

31 

112 

121 

122 

124 

pcl6dl 

7 

25 

42 

55 

79 

112 

121 

122 

124 

pcl6d2 

7 

25 

31 

42 

52 

112 

121 

122 

124 

pcl6el 

7 

11 

21 

26 

52 

84 

121 

122 

124 

pcl6e2 

7 

25 

26 

47 

79 

112 

121 

122 

124 

pcl6fl 

7 

13 

21 

104 

110112 

118 

121 

122 

pcl6f2 

7 

11 

13 

19 

100  103 

121 

122 

124 

pcl6gl 

7 

13 

28 

35 

62 

104 

112 

121 

122 

pcl6g2 

7 

19 

28 

41 

79 

112 

121 

122 

124 

pcl6hl 

7 

13 

28 

38 

59 

104 

112 

121 

122 

pcl6h2 

7 

19 

31 

41 

79 

112 

121 

122 

124 

pci 6i  1 

7 

13 

38 

61 

91 

104 

112 

121 

122 

pcl6i2 

7 

13 

22 

38 

59 

104 

112 

121 

122 

pcl6jl 

7 

13 

44 

55 

104 

110 

112 

121 

122 

pcl6j2 

7 

13 

38 

59 

61 

104 

112 

121 

122 

pcl6kl 

7 

13 

44 

79 

104 

110 

112 

121 

122 

pcl6k2 

7 

13 

38 

59 

91 

104 

112 

121 

122 

pci  611 

7 

38 

61 

69 

94 

104 

112 

121 

122 

pci 612 

7 

13 

22 

59 

91 

104 

112 

121 

122 

pc  16ml 

7 

13 

22 

44 

49 

62 

112 

121 

122 

pcl6m2 

7 

13 

44 

59 

91 

104 

112 

121 

122 

pcl6nl 

7 

13 

22 

44 

49 

82 

112 

121 

122 

pcl6n2 

7 

13 

44 

55 

59 

104 

112 

121 

122 

pcl6ol 

7 

19 

28 

35 

61 

76 

112 

121 

122 

pcl6o2 

7 

28 

38 

47 

61 

104 

112 

121 

122 

pcl6pl 

7 

21 

25 

47 

55 

84 

112 

121 

122 

pcl6p2 

7 

28 

38 

47 

59 

104 

112 

121 

122 

pcl6ql 

7 

11 

19 

38 

44 

52 

100 

121 

122 

pcl6q2 

7 

13 

21 

38 

59 

104 

112 

121 

122 

pcl6rl 

7 

11 

19 

38 

44 

100 

103 

121 

122 

pcl6r2 

7 

13 

21 

59 

91 

104 

112 

121 

122 

42 


Problem  Case  4: 


The  fourth  case  occurs  at  k  =  19.  The  following  two  pairs  of  designs  have 
identical  G(T2D)  values,  word  length  pattern,  alias  length  pattern,  and  letter  pattern 

matrices  respectively.  They  are  only  distinguished  by  their  sets  of  delete-one-factor 
projections.  The  first  pair  (pcl9al  and  pcl9a2)  are  even  designs,  the  second  pair  are 
even/odd  designs.  Table  1 1 .4  lists  the  generators  for  these  designs. 


Table  11.4:  k  =  19,  n  =  128  Problem  Designs _ 

Design  Generators _ 

pci 9a 1  7  13  22  44  49  62  91  98  112  118  121  122 

pcl9a2  7  13  22  44  49  62  91  98  112  121  122  124 

pci 9b 1  7  11  25  31  35  50  85  104  112  121  122  124 

pc!9b2  7  11  25  31  35  50  86  104  112  121  122  124 
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12.  Finding  Good  Designs  Using  Naive  Projections 

As  noted  previously,  the  difficulty  of  finding  minimum  aberration  designs  (and 
other  good  designs)  increases  as  n  becomes  larger.  Examining  the  case  of  n  =  64 
suggests  that  sequentially  eliminating  factors  to  minimize  the  number  of  length  four 
words  in  the  resulting  design  (ties  broken  by  the  minimization  of  length-five  words,  then 
length-six  words,  etc.)  from  a  relatively  few  sos  designs  present  a  few  design  arrays  from 
which  good  (minimum  aberration)  designs  are  found.  This  method  will  be  referred  to  as 
the  naive  projection  approach. 

Table  12.1  lists  the  number  of  length-four  words  (w4)  for  minimum  aberration 
designs  and  for  the  naive  projections  from  each  of  the  eight  even/odd  sos  designs  for  n  = 
64.  The  naive  projections  that  result  in  the  minimum  aberration  design  are  marked  with 
while  those  projections  resulting  in  a  weak  minimum  aberration  design  are  marked 

with 


Table  12.1:  Number  of  Length-Four  Words  for  SOS  Naive  Projections,  n  =  64 


k 

MA 

sos20 

sosl8 

sos!7b 

sosl7d 

sosl7e 

sosl7g 

sosl7i 

sosl3 

20 

125 

125* 

19 

100 

100* 

18 

78 

78* 

92 

17 

59 

59* 

68 

60 

65 

68 

73 

105 

16 

43 

43* 

49 

45 

45 

49 

53 

77 

15 

30 

30* 

34 

33 

33 

33 

37 

55 

14 

22 

22* 

22** 

23 

23 

23 

24 

38 

13 

14 

15 

14* 

15 

15 

15 

16 

25 

14** 

12 

6 

9 

8 

10 

10 

10 

10 

15 

6* 

11 

4 

5 

4* 

6 

6 

6 

5 

9 

4* 

10 

2 

2* 

2* 

3 

3 

3 

3 

5 

2* 

9 

1 

1* 

1* 

1* 

1* 

1* 

1* 

2 

1* 

8 

0,2 

0* 

0* 

0* 

0* 

0* 

0* 

0* 

0* 

*  =  minimum  aberration;  **  =  weak  minimum  aberration 
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It  is  interesting  to  note  that  the  20-factor  sos  design  projects  to  the  minimum 
aberration  design  for  k=  14, 15, 20  (and  also  8,  9,  and  10);  the  13-factor  sos  design  is 
weak  minimum  aberration  at  k  =  13,  and  its  naive  projections  are  minimum  aberration  for 
k  =  8, 9, . . 12.  The  weak  minimum  aberration  sos  design  at  £  =  13  has  36  clear  two- 
factor  interactions,  16  more  than  the  minimum  aberration  design  and  is  arguably 
preferred  over  the  minimum  aberration  design  due  to  the  more  clear  two-factor 
interactions. 

Since  sequential  projection  from  just  two  n  =  64  run  designs  provide  attractive 
designs  for  all  k  =  8,  9, . . .,  20,  we  list  these  two  sos  designs  in  Table  12.2,  arranging  the 
design  columns  so  that  one  only  needs  to  include  the  number  of  generators  that 
correspond  to  the  desired  number  of  factors.  For  instance,  for  the  minimum  aberration 
18-factor  design,  simply  omit  the  last  two  columns  of  the  20-factor  design.  The  20-14.a 
sos  design  is  recommended  for  k  =  14,  ...,20andthe  1 3-7 .b  design  for  k  =  8, ...,  13. 
These  designs  and  their  embedded  projections  are  the  minimum  aberration  or  most 
preferred  designs  available  for  every  k  e[8,20] .  Figures  12.1  and  12.2  show  the  aliasing 
of  two-factor  interactions  for  these  two  sos  designs,  with  generators  as  specified  in  Table 
12.2.  By  arranging  into  columns  the  interactions  in  these  tables,  we  conveniently  and 
compactly  present  the  aliasing  for  each  of  the  embedded  designs.  These  tables  enable  a 
practitioner  to  visualize  the  additional  confusion  regarding  two-factor  interactions  that 
result  from  adding,  e.g.,  two  or  three  more  factors  to  a  10-factor  design. 

SOS  designs  represent  a  small  fraction  of  all  possible  resolution  IV  designs  and 
yet  they  project  to  all  remaining  resolution  IV  designs.  Thus  from  this  subset  one  can 
project  to  all  minimum  aberration  and  other  good  designs.  Complete  enumeration  of 
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Table  12.2;  Generators  for  SOS  Embedded  Projection  Designs  of  Size  64 _ 

Design  Generators  for  Factors  7-20  (identified  by  Yates  column  number) _ 

20-14.a  31  39  43  61  49  54  13  21  14  19  25  28  44  58 

13-7.b  31  39  43  61  51  62  28 


Design  13-7.b  Generators  (Yates  column  number) _ _ _ 

31  39  43  61  51  62  28 

Singularity  Details  (All  interactions  not  listed  are  clear  for  designs  with  k<  13) 

*• _ 7  8  9  10  11  12  13 


3*8  =  4*9  = 

5*11 

6*7  = 

2*10  = 

1*12 

4*8  =  3*9  = 

11*13 

3*4  = 

8*9  = 

5*13 

2*7  = 

6*10  = 

1*13 

2*6  = 

7*10  = 

12*13 

5*8  = 

3*11  = 

9*13 

5*9  = 

4*11  = 

8*13 

3*5  = 

8*11  = 

4*13 

4*5  = 

9*11  = 

3*13 

1*10  = 

2*12=  6*13 

1*7  = 

6*12=  2*13 

1*6  = 

7*12=  10*13 

1*2  = 

10*12  =  7*13 

Figure  12.1:  Design  13-7.b  Generators  and  Aliasing  for  Embedded  Projections 
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Design  20-14.a  Generators  (Yates  column  number) 


31  39  43  61  49  54  13 

21 

14 

19  25 

28 

44  58 

Singularity  Details  k : 

14 

15 

16  17 

18 

19  20 

1*5  =6*11  =  8*12  = 

3*14  = 

7*15  = 

2*16=  4*17  = 

13*18  = 

10*19=  9*20 

2*7  =  6*10  =  9*12  =  5*13  = 

4*14  = 

15*16=  3*17  = 

1*18  = 

11*19=  8*20 

3*4  =  8*9=  10*11  =  1*13  = 

2*15  = 

7*16=  14*17  = 

5*18  = 

6*19=  12*20 

6*8  =  11*12  = 

9*19=  10*20 

6*9  = 10*12= 

8*19=  11*20 

8*10  =  9*11  = 

12*19=  6*20 

1*9  =8*13  = 

12*18  = 

5*20 

5*8  =  1*12  = 

9*18  = 

13*20 

5*9  =  12*13  = 

8*18  = 

1*20 

3*8  =4*9  = 

12*14  = 

17*20 

4*12  = 

9*14  = 

8*17  = 

3*20 

3*9  =4*8  = 

12*17  = 

14*20 

7*8  = 

12*15  = 

9*16  = 

2*20 

7*9  =  2*12  = 

8*16  = 

15*20 

2*8  = 

9*15  = 

12*16  = 

7*20 

2*9  =7*12  = 

8*15  = 

16*20 

9*10  =  8*11  =  6*12  = 

19*20 

1*8  =5*12  =  9*13  = 

18*20 

3*12  = 

8*14  = 

9*17  = 

4*20 

3*6  = 

11*14  = 

10*17  = 

4*19 

3*10  =4*11  = 

6*17  = 

14*19 

4*6  = 

10*14  = 

11*17  = 

3*19 

4*10=  3*11  = 

6*14  = 

17*19 

7*11  = 

6*15  = 

10*16  = 

2*19 

1*6  =5*11  = 

10*18  = 

13*19 

1*10  =11*13= 

6*18  = 

5*19 

5*10  =  6*13  = 

11*18  = 

1*19 

5*6=1*11  =10*13  = 

18*19 

2*6  =  7*10  = 

11*16  = 

15*19 

6*7  =  2*10  = 

11*15  = 

16*19 

2*11  = 

10*15  = 

6*16  = 

7*19 

1*2  = 

13*15  = 

5*16  = 

7*18 

1*7  = 

5*15  = 

13*16  = 

2*18 

1*3  =4*13  = 

5*14  = 

17*18 

1*4  =3*13  = 

5*17  = 

14*18 

3*5  = 

1*14  = 

13*17  = 

4*18 

4*5  = 

13*14  = 

1*17  = 

3*18 

5*7  =  2*13  = 

1*15  = 

16*18 

2*5  =  7*13  = 

1*16  = 

15*18 

3*7  = 

14*15  = 

4*16=  2*17 

2*3  = 

4*15  = 

14*16=  7*17 

2*4  = 

7*14  = 

3*15  = 

16*17 

4*7  = 

2*14  = 

3*16  =  15*17 

Figure  12.2:  Design  20-14.a  Generators  and  Aliasing  for  Embedded  Projections 
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these  projections  is  prohibitive  for  large  n.  However,  we  have  found  that  naive 
projections  from  sos  designs  at  n  =  64  and  n  =  128  identify  the  best  resolution  IV  designs. 

It  is  known  from  projective  geometry  that  for  n  =  16, 32, 64, ...,  sos  designs  exist 
at  k  =  ti/4  +  1  (Cheng  2002).  Furthermore  any  sos  design  D  with  k  factors,  and  n  runs 


can  be  doubled  by  the  construction  method 


D 

D 


D 

-D 


to  produce  a  sos  design  of  size  2k 


factors  and  In  runs  (Cheng  2002).  For  k>nl 4  +  1,  all  sos  designs  are  doubled  sos 
designs.  To  construct  sos  designs  for  k  =  n! 4+1,  see  Cheng  (2003).  Unfortunately, 
these  designs  only  represent  a  small  fraction  of  the  total  sos  designs  that  exist  for  any 
given  n. 

Complementing  Cheng’s  theoretical  results,  we  have  determined  for  n  =  128  that 
there  exist  88  resolution  IV  sos  designs,  50  with  k  >  n /  4  + 1 ,  and  38  with  k  <  n/4.  Figure 
12.3  summarizes  these  findings.  Na'ive  projections  of  these  sos  designs  lead  to  minimum 
aberration  designs.  Table  12.3  lists  the  length  four  words  resulting  from  the  naive 
projections  for  k  —  24, 22,  and  21  sos  designs.  Table  12.4  lists  the  naive  projections  for 
the  k  =  25  sos  designs.  Table  12.5  lists  the  naive  projections  for  k  =  29,  28,  27,  and  26 
sos  designs.  Table  12.6  lists  the  naive  projections  for  the  top  ten  sos  designs  at  k  =  33. 
Table  12.7  lists  the  naive  projections  for  k  =  40,  36,  34,  and  3 1  sos  designs. 

We  have  found  88  sos  designs  at  14  different  values  of  k  at  n  =  128.  Four  of  these 
sos  designs  are  the  minimum  aberration  design;  this  occurs  at  k  =  25,  29, 40,  and  64.  It  is 
interesting  to  note  that  even  some  of  the  less  desirable  (in  terms  of  wlp)  sos  designs  often 
project  to  minimum  aberration  designs  and  other  good  designs.  For  instance,  at  k  =  28, 
the  sos  design  28-21.1 157  (ranked  number  1 157  in  terms  of  wlp)  naively  projects  to  the 
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n  =  8  n  =  16 

n  =  32 

n  =  64 

n  =  128 

kfn 

£  =  4  £=8 

£=16 

£=32 

£=64 

1/2 

£=10 

£=20 

£  =  40 

5/16 

£  =  9 

£=  18 

£=36 

9/32 

17(5  types) 

^  34(5  types)  17/64 

A:  =  33(42  types)  33/128 

Note:  All  sos  designs 

65/256 

below  the  dashed  line  are 
even/odd  designs. 

£=31 
£  =  29 
£=28 
£  =  27 

£=13 

£  =  26 
£=25 
£  =  24 

>■  38  designs 

£  =  22 
£  =  21 

Figure  12.3:  Existence  of  SOS  Designs 
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Table  12.3:  k  =  24, 22,  and  21  SOS  Designs  Naive  Projections  Length-4  Words  (W4,...)» n  —  128 
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Table  12.4:  A  =  25  SOS  Designs  Naive  Projections  Length-4  Words  (W4,...),  n  =  128  _ 
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Table  12.5:  k  =  29, 28, 27,  and  26  SOS  Designs  Naive  Projections  Length-4  Words  (w4,...),  n  -  128 
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Table  12.6:  Top  Ten  k  =  33  SOS  Designs  Naive  Projections  Length-4  Words  (W4,...),  ft  =  128 _ 

k _ MA _ sos33a  sos33b  sos33c  sos33d  sos33e  sos33f  sos33g  sos33h  sos33i  sos33j 
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Table  12.7:  k  -  40, 36, 34,  and  31  SOS  Designs  Naive  Projections  Length-4  Words 
(w4,...),  yi  =  128 _ _ _ _ 


K 

MA 

sos40 

sos36 

sos34a 

sos34b 

sos34c 

sos34d 
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sos31a 

sos31b 
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39 
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95 

96 

101 

100 

140 

86 

94 

22 

65 

79 

73 

76 

78 

81 

77 

109 

68 

74 

21 

51 

61 

59 

59 

62 

63 

61 

85 

55 

56 

20 

36 

45 

47 

44 
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minimum  aberration  design  for  k  =  20, 19,  and  15;  and  the  weak  minimum  aberration 
design  for  k  =  18  and  17. 
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13.  Preliminary  Results  for  Resolution  IV  Designs  of  Size  256 


While  identifying  almost  300,000  even/odd  designs  at  n  =  128  was  challenging, 
this  pales  with  the  challenge  of  exhaustively  enumerating  all  designs  for  n  =  256  due  to 
the  great  number  of  designs.  For  example,  while  only  88  sos  designs  exist  at  n  =  128,  we 
have  found  over  34,000  sos  designs  in  random  searches  at  n  =  256  (See  Table  13.1). 

To  aid  in  finding  good  designs,  we  implemented  a  method  that  combined  some  of 
our  more  successful  strategies  for  finding  good  designs  at  n  =  64  and  n  =  128.  Our  search 
at  n  =  256  used  two  basic  approaches.  The  first  approach  consists  of  a  random  search  for 
sos  designs  by  starting  with  a  design  whose  columns  formed  a  full  factorial  and  then 
randomly  adding  generators  to  available  columns  one  at  a  time  until  an  sos  design  is 
discovered  (stopping  if  k  >  65  since  all  50  sos  designs  in  this  range  are  already  known). 
Then  from  these  sos  designs,  we  find  good  designs  from  the  sos  designs  by  naive 
projection.  The  second  approach  was  to  find  new  designs  by  sequentially  building  up  a 
factor  at  a  time  using  tD  as  a  flawed  isomorphic  rule  to  check  for  isomorphism  and 
retaining  the  top  2,000  designs  from  each  sequential  search  and  building  up  from  those 
2,000  designs. 


Table  13.1:  Number  of  Regular  Resolution  IV*  designs 

n 

#  of  even/odd  sos 
designs 

#  of  even/odd 
designs 

#  of  even 
designs 

#  of  even  sos 
designs 

16 

1 

1 

4 

1 

32 

2 

5 

20 

1 

64 

8 

150 

349 

1 

128 

87 

>296,960 

>  106 

1 

256 

>34,015 

? 

? 

1 
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For  naive  projection  from  sos  designs  approach,  there  are  at  least  three  ways  to 
find  sos  designs: 

•  Double  the  sos  designs  at  n  =  128 

•  Random  addition  of  eligible  columns  until  an  sos  design  is  found 

•  Find  good  designs  using  software  for  fixed  k  and  then  build  up  to  an  sos 
design 

For  the  sequential  buildup  technique  the  issue  of  which  subset  of  designs  to  retain 
at  each  step  is  critical.  For  instance,  if  only  the  top  1 ,000  designs  are  retained  at  each 
buildup  step  for  n  =  256,  then  all  the  designs  buildup  to  sos  designs  with  k  <  40 .  Future 
work  will  explore  this  issue. 

From  Franklin  (1984)  we  know  the  minimum  aberration  values  for  designs  with 
up  to  k  =  17  factors  for  n  =  256.  We  also  know  that  as  early  as  k  =  1 1 ,  we  will  lose  some 
designs  using  tD  as  a  flawed  isomorphic  rule.  However,  we  still  find  all  the  known 
minimum  aberration  designs.  At  k  =  17,  we  found  33,142  resolution  IV  designs  with 
different  tD .  Of  those,  32,126  are  even/odd  designs.  The  1,016  even  designs  will 
continue  to  grow  in  number,  approximately  doubling  at  each  factor  until  they  reach  k  = 
64.  Based  upon  our  results  as  n  =  128,  we  would  expect  the  number  of  even/odd  designs 
to  increase  for  each  factor  until  k  =  44,  and  then  gradually  decline  at  each  factor  until  k  = 
80.  (See  Table  13.2). 
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Table  13.2;  Existence  of  Regular  Resolution  IV+  designs 


k 

#  of 

#  of  even 

#of 

#  of  even 

#  of  e/o  designs 

#  even  designs 

even/odd 

designs, 

even/odd 

designs, 

based  on 

based  on 

designs, 

«  =  64 

n  =  64 

designs, 
n  =  128 

n  =  128 

tD /G(T2D) 

n  =  256 

tD/G(T2D), 

n  =  256 

7 

2 

2 

- 

_ 

8 

3 

4 

2 

3 

- 

. 

9 

6 

6 

7 

6 

3/3 

3/3 

10 

12 

12 

19 

14 

12/12 

9/9 

11 

20 

14 

62 

30 

44/50 

17/24 

12 

22 

21 

180 

69 

153/231 

44/80 

13 

24 

23 

487 

136 

536/  1,188 

89/241 

14 

20 

29 

1,240 

295 

1,690/6,505 

176/839 

15 

15 

29 

2,926 

596 

4,668  /  54,269 

312/3,467 

16 

11 

37 

6,208 

1,292 

12,598/  ? 

564/  ? 

17 

10 

30 

11,787 

2,651 

32,126/  ? 

1,016/  ? 

18 

3 

30 

19,466 

5,598 

? 

? 

19 

1 

24 

27,994 

11,341 

? 

? 

20 

1 

23 

35,192 

22,728 

? 

? 

21 

- 

16 

39,201 

43,516 

? 

? 

22 

- 

15 

38,847 

79,603 

? 

? 

23 

- 

9 

34,868 

? 

? 

? 

24 

- 

8 

28,133 

? 

? 

? 

25 

- 

5 

20,569 

? 

? 

? 

26 

4 

13,498 

? 

? 

? 

27 

- 

2 

8,075 

? 

? 

? 

28 

- 

2 

4,284 

? 

? 

? 

29 

- 

1 

2,149 

? 

? 

? 

30 

- 

1 

976 

? 

? 

? 

31 

- 

1 

433 

? 

? 

? 

32 

- 

1 

197 

? 

? 

? 

33 

- 

- 

101 

? 

? 

? 

34 

- 

- 

31 

? 

? 

? 

35 

- 

- 

13 

? 

? 

? 

36 

- 

8 

9 

? 

? 

37 

- 

- 

3 

? 

? 

? 

38 

- 

- 

2 

? 

? 

? 

39 

- 

- 

1 

? 

? 

? 

40 

- 

- 

1 

? 

? 

? 
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The  sheer  number  of  designs  that  exist  at  larger  n  shows  the  value  of  the  naive 
projection  method.  We  are  able  to  rather  efficiently  evaluate  the  naive  projections  of  sos 
designs  at  n  =  256.  Table  13.3  below  shows  the  best  designs  found  (based  on  wlp)  for 
each  respective  k,  and  the  corresponding  alp,  number  of  degrees  of  freedom  used  for 
main  effects  and  two-factor  interactions,  the  number  of  clear  two-factors,  and  Lmax  for 
each  design.  The  Yates  ordered  columns  for  those  designs  are  listed  in  Table  13.4. 

We  have  found  over  34,015  sos  designs  at  n  =  256.  The  sos  designs  found  occur 
at  k =  33, . 66,  68, 72,  80,  and  128  at  n  =  256.  Future  work  will  involve  improving 

methods  of  finding  good  sos  designs. 

Additional  future  work  will  involve  looking  at  ways  to  refining  the  naive 
projection  method  to  possibly  including  additional  projections.  It  is  no  surprise  that 
empirical  evidence  at  n  =  128  demonstrated  at  times  the  second  best  (or  worse)  projection 
for  one  design,  could  eventually  lead  to  a  better  design  a  few  projections  later.  Consider 
the  even/odd  2,°~33  design.  The  naive  projections  based  on  minimizing  tD  lead  to  a 

different  design  at  K  =  16  than  if  the  criteria  looked  at  only  minimizing  the  length-4  and 
length-5  words  with  ties  broken  arbitrarily.  The  hope  would  be  to  find  a  method  to 
identify  which  small  set  of  projections  lead  to  good  designs.  We  would  want  as  small  a 
set  of  projections  as  possible  that  lead  to  good  designs  to  avoid  the  combinatorial 
problem  of  having  to  look  at  all  possible  combinations  of  projections. 
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Table  13.3  (Continued 
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14.  Conclusions 


This  dissertation  has  introduced  the  alp  which  provides  another  useful 
characterization  of  designs.  The  alp  of  a  design  contains  the  number  of  clear  two-factor 
interactions,  the  number  of  degrees  of  freedom  used  for  main  effects  and  two-factor 
interactions,  and  lists  the  length  of  the  largest  set  of  aliased  two-factor  interactions.  The 
alp  can  be  used  to  calculate  the  number  of  length-four  words,  and  is  helpful  in 
differentiating  designs. 

We  have  also  studied  projections  of  designs.  We  now  know  that  all  regular 
resolution  IV  designs  have  at  least  one  sos  parent.  We  know  an  examination  of 
projections  from  all  the  sos  designs  will  result  in  a  complete  set  of  regular  resolution  IV 
designs.  We  have  introduced  a  method  to  find  good  designs  using  naive  projections  from 
sos  designs  instead  of  an  exhaustive  search. 

We  have  examined  some  of  the  properties  of  the  T  matrix  and  demonstrated  its 
usefulness  in  searching  for  good  designs.  We  have  found  the  minimum  aberration 
designs  for  n  =  128  based  upon  our  isomorphic  conjecture.  We  list  not  only  these  designs 
and  their  properties,  but  provide  a  catalog  of  designs  with  respect  to  word  length  pattern, 
degrees  of  freedom  used,  clear  two-factor  interactions,  and  minimizing  the  length  of  the 
longest  set  of  aliased  two-factor  interactions. 

We  know  that  the  naive  projections  from  sos  designs  leads  to  all  the  minimum 
aberration  values  for  n  =  32,  64,  and  128.  We  know  that  the  number  of  regular  resolution 
IV  designs  increases  at  a  rate  that  makes  exhaustive  searches  infeasible  beyond  n  =  128 
using  current  technology.  We  know  that  projections  from  the  doubled  sos  design  at 
k  =  (5/16 )n  results  in  excellent  (and  very  often  minimum  aberration)  designs.  We 
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provide  a  number  of  interesting  designs  at  n  =  128  that  are  alike  in  several  (sometimes 
all)  characterization  criteria,  yet  non-isomorphic. 

Finally,  we  have  found  over  34,015  sos  designs  for  n  =  256.  We  show  how  the 
magnitude  of  the  number  of  designs  increases  with  larger  n.  We  use  naive  projections 
and  build  up  using  the  best  2,000  designs  to  provide  a  preliminary  table  of  the  best 
designs  at  n  =  256. 
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Yates  Column  Order  Generator  Matrix,  For  r  >  129,..., 255  i 
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18 ,  Design  generators 
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k  =  26,  Designs  sorted  based  on  word  length  pattern _ _ _ _ _ 

Design  wlp(w4,.'..)  wlp  alp  df  C2FI  Lmax  df  C2FI  Lmax  CD2*  CD2 

_ rank _ _ _ rank  rank  rank _ rank 

26-19.1  152  568  1704  1  0  29  41  4  16  80000000  124  0  6  13  13068  1  8.5797  1 

26-19.2  155  555  1720  2  5  20  45  5  13  10  0  0  0  0  0  0  0  124  5  6  14  12525  2  8.5819  2 
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26,  Designs  sorted  based  on  the  number  of  clear  two-factor  interactions 
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26,  Design  generators 
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